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Method of visualizing a poin ter during interact ion 



The invention relates to a method of visualizing a pointer during interaction of 
the pointer with an image, the pointer being controllable by a user. 

" The invention fiirther relates to a system for visualizing a pointer during 

interaction of the pointer with an image, the pointer being controllable by a user. 
5 The invention further relates to a computer program product to perform such a 

method. 

The invention fiirther relates to a computer readable medium having stored 
thereon instructions for causing one or more processing units to perform such a method. 

The invention further relates to an imaging diagnostic apparatus for carrying 
10 out such a method. 

Computing devices, such as a personal computer (pc), a workstation, a 
personal digital assistant (pda), etc are arranged to display images onto a screen that is 

15 connected to the computing device. The displayed images can have all kinds of formats like 
jpeg, TIFF, gif, etc. and the images can have all kinds of sources, like a digital still camera, or 
a medical image acquisition system, like a computerized tomography scanner (CT-scanner), a 
magnetic resonance scanner (MR-scanner), an X-ray scanner, etc. Further, the images can 
also be drawings of objects that can for example be displayed within a text-based document 

20 like MsWord of Microsoft Corporation, or a drawing from a drawing application like 

AutoCad of Autodesk For example, within most text-processing applications it is possible for 
a user to draw objects like arrows, boxes, spheres, etc. A user can instruct the computing 
device to perform image enhancement operations upon the image like zooming, panning, 
adjusting contrast/brightness, adjusting the color/position/size/shape of objects like boxes, 

25 spheres, poly-lines, etc. The user can control the position within the image where a specific 
image enhancement operation should be performed, by controlling an input device that is 

connected to the computing device. Such an input device is for example a mouse or a stylus. 

The input device is visualized upon the screen by a cursor and the user can control the 
position of the cursor within the image by manipulating the input device. Usually, the 
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_ computing device gives feedback to the user of the chosen image enhancement operation by 
displaying a cursor that corresponds to the chosen operation. 

Figure la illustrates an example of a cursor interaction within MsWorcL A 
document 100 comprises an object in the shape of a box 102 and the user is in control of 
5 cursor 104. When the user moves cursor 104 inside the box 102, the cursor's representation 
changes into a cross 106, see Figure lb. This cross 106 indicates to a user that the user can 
select an interaction mode that enables a user to move the box to a different position. When 
the user selects this "move" interaction mode, and the user moves the box 102 by dragging 
the cursor to a different position, the cursor keeps its cross shape. 
10 When the user moves the cursor 104 to a corner of the box 102, the cursor's 

representation changes into a resize-handle 108, see Figure lc. This handle indicates to a user 
that the user can select an interaction mode that enables a user to resize the box 102. When 
the user selects this "resize" interaction mode, and the user resizes the box 102 by dragging 
the cursor to a different position, the cursor changes it shape into a small cross 110, see 
15 Figure Id. 

It is an object of the current invention to provide a method according to the 
opening paragraph that allows a user to interact with an image in an improved way. To 

20 achieve this object, the method comprises: moving the pointer to a first position within the 
image by the user; displaying the pointer corresponding to an interaction mode related to the 
first position within the image; selecting the interaction mode; moving the pointer to a second 
position within the image by the user while performing the selected interaction mode upon 
the image; and hiding the pointer during moving the pointer to the second position within the 

25 image. By hiding the pointer during the manipulation of the pointer by a user whiie 

performing an interaction with the image, the pointer obscures less of the image. This enables 
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A further embodiment of the method is disc losed in claim 3 . By enab ling a_ 
user to re-display the hidden pointer the user can dynamically decide to see or hide the cursor 
during manipulation of the image. 

It is an object of the current invention to provide a system according to the 
5 opening paragraph that displays a cursor during interaction in an improved way. To achieve 
this object, the system comprises: a mover for moving the pointer to a first position within 
the image by the user; a displayer for displaying the pointer corresponding to an interaction 
mode related to the first position within the image; a selector for selecting the interaction 
mode; a mover for moving the pointer to a second position within the image by the user 
1 0 while performing the selected interaction mode upon the image; and a hider for hiding the 
pointer during moving the pointer to the second position within the image. 

Embodiments of the system are disclosed within claims 5 and 6. 



1 5 These and other aspects of the invention will be apparent from and elucidated 

with reference to the embodiments described hereinafter as illustrated by the following 
Figures: 

Figures la, lb, lc, and Id illustrate an example of a prior art cursor 

interaction; 

20 Figures 2a, 2b, and 2c illustrate a mouse manipulation within a medical image; 

Figures 3a, 3b, and 3c illustrate a mouse manipulation within a drawing; 
Figures 4a, 4b, and 4c illustrate a mouse manipulation within a region of 

interest; 

Figure 5 illustrates a system according to the invention in a schematic way. 

25 

Figure 2a illustrates a mouse manipulation within a medical image. The 
medical image 200 is an X-ray image of a thorax 202. In stead of an X-ray image, an other 
acquisition technique could be used, like Ultrasound, etc. A user is in control of the cursor 
30 204 at position 210, next to the cursor 204 an interaction mode 206 is displayed that indicates 
that the user can adjust the contrast or brightness of the image 200 by moving the cursor 204. 
Instead of adjusting thexontrast or brightness other image enhancement techniques can be 
chosen, like changing the window width/window level, re-positioning shutters, change the 
colour, enhance sharpness, blurring, gamma-correction, etc. The user is in control of the 



PHNL03 1423EPQ 



4 27.11.2003 
cursor by manipulating a mouse (not shown). The mouse comprises buttons and the user can 
select the interaction mode by pressing an appropriate button. Other devices of enabling a 
user to control the mouse and other ways of selecting the interaction mode are also possible. 
For example, a stylus could be used to control the mouse and a double push of the stylus 
against a touch-sensitive tablet could select the interaction mode. After the user has selected 
the interaction mode, the cursor changes its representation as illustrated within Figure 2b. 
Here, 208 indicates that the user has chosen to adjust the brightness of image 200 while the 
cursor 204 is hidden. Although the cursor is hidden, the user can still control the position of 
the cursor by manipulating the input device, i.e. the mouse. After the user has deselected the 
interaction mode, for example by releasing the appropriate button of the mouse, the cursor is 
displayed again at the position controlled by the user as illustrated within Figure 2c. Here, 
212 is the new position where the user has navigated the cursor 204 to while adjusting the 
brightness of the image 200. 

Figures 3a illustrates a mouse manipulation within a drawing. The drawing 
300 comprises a rectangle 302. The drawing 300 can be any kind of drawing like AutoCad or 
a drawing within an editor like MsWord, MsPowerPoint, etc. The rectangle 302 is an shape 
within the drawing 300. Other shapes are also feasible, like a sphere, polylines, arrows, etc. A 
user is in control of the cursor 304 at position 310, next to the cursor 304 an interaction mode 
306 is displayed that indicates that the user can resize the rectangle 302 by moving the cursor 
304. After the user has selected the interaction mode, the cursor is hidden as illustrated within 
Figure 3b, while the user is resizing the rectangle 302. The user resizes the rectangle 304 by 
controlling the position of the hidden cursor by manipulating an input device like the mouse 
as described above. After the user has deselected the interaction mode, for example by 
releasing the appropriate button of the mouse, the cursor is displayed again at the position 
controlled by the user as" illustrated within Figure 3 c. Here, 312 is the new position where the 
user has navigated the cursor 304 to while adjusting the size of the rectangle 304. 
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4b. When the cursor 406 and/or the toteraction mode 408 leaves the region of interest, it is 

shown again as illustrated in Figure 4c. There the cursor 406 and the interaction mode 408 
are displayed at position 412 towards which the user has moved the cursor from its start 
position as illustrated within Figure 4a. 
5 In addition to the cursor manipulations as described above, the user is offered 

to control the display of the cursor. The user can enforce displaying and/or hiding Ihe cursor 
during, before or after selection of the interaction mode. 

Figure 5 illustrates a system according to the invention in a schematic way. 
The system 500, comprises a central processing unit (cpu) 510, computer readable memories 

10 502, 504, 506, and 508 that are conmiunicatively connected to each other through software 
bus 512. The system 500 is further connected to a display screen 514 and an input device 516 
like a mouse. The computer readable memory 502 comprises computer readable code that is 
designed to move a cursor to a first position on the display screen 514 within an image (not 
shown). A user who manipulates the input device 516 controls the first position of the cursor. 

1 5 The computer readable memory 504 comprises computer readable code that is designed to 
display the cursor corresponding to an interaction mode related to the first position within the 
image as previously described. The computer readable memory 506 comprises computer 
readable code that is designed to that is designed to select the interaction mode by receiving 
the corresponding commands from the input device 516. The computer readable memory 504 

20 is further designed to comprise computer readable code for moving the pointer to a second 
position within the image by the user while the selected interaction mode is being performed 
upon the image. The computer readable memory 508 comprises computer readable code for 
hiding the pointer during moving the pointer to the second position within the image as 
previously described. The computer readable memories are random access memories (RAM), 

25 but other memories can be used too like read-only memories (ROM). Further the memories 
can be integrated into a single memory comprising the whole computer readable code ifor 
performing the separate steps of the method according to the invention. The computer 
readable code can be downloaded into the system 500 from a computer readable medium like 
a compact disk (CD), a digital versatile disk (DVD) etc. 

30 It should be noted that the above-mentioned embodiments illustrate rather than 

limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the.scope of the appended claims. In the claims, any 
reference signs placed between parentheses shall not be construed as limiting the claim. The 
word "comprising" does not exclude the presence of elements or steps other than those listed 
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in a claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
comprising several distinct elements, for example an image acquisition device lite an MR, 
X-ray, or Ultrasound scanner, and by means of a suitably programmed computer. In the 
system claims enumerating several means, several of these means can be embodied by one 
and the same item of computer readable software or hardware. The mere feet that certain 
measures are recited in mutually different dependent claims does not indicate that a 
combination of these measures cannot be used to advantage. 
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CLAIMS: 



1 - Method of visualizing a pointer during interaction of the pointer with an 

image, the pointer being controllable by a user, the method comprising: 

moving the pointer to a first-position-within the image-bjMhe user; ~ . 

displaying the pointer corresponding to an interaction mode related to the first 
5 position within the image; 

selecting the interaction mode; 

moving the pointer to a second position within the image by the user while 
performing the selected interaction mode upon the image; and 

hiding the pointer during moving the pointer to the second position within the 

10 image. 

2. Method according to claim 1, wherein the image comprises a region of interest 
and the step of hiding the pointer comprises hiding the pointer within the region of interest 
during moving the pointer to the second position. 

15 

3. Method according to claim 1 or 2, the method further comprising displaying 
the pointer during moving the pointer to the second position upon request by the user. 

4. System (500) for visualizing a pointer during interaction of the pointer with an 
20 image, the pointer being controllable by a user, the system comprising: 

a mover (502) for moving the pointer to a first position within the image by 

the user; 

a displayer (504) for displaying the pointer corresponding to an interaction 
mode related to the first position within the image; 
25 a selector (506) for selecting the interaction mode; 

a mover (502) for moving the pointer to a second position within the image by 
the user while performing the selected interaction mode upon the image; and 

a hider (508) for hiding the pointer during moving the pointer to the second 
position within the image. 
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5. System (500) according to claim 4, wherein the image comprises a region of 
interest and the hider (508) is arranged to hide the pointer within the region of interest during 
moving the pointer to the second position* 

5 

6. System (500) according to claim 4 or 5, wherein the displayer (504) is further 
arranged to display the pointer during moving the pointer to the second position. 

7. Computer program product designed to perform the method according to any 
10 of the claims 1 to 3. 

8. Computer readable medium having stored thereon instructions for causing one 
or more processing units to perform the method according to any of the claims 1 to 3. 

15 9. An imaging diagnostic apparatus for carrying out the method according to any 

of the claims 1 to 3. 
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ABSTRACT: 



The invention relates to a method of visualizing a pointer during interaction of 
the pointer with an image, the pointer being controllable by a user, the method comprising: 

moving4he pointer to-a43rs^ 

corresponding to an interaction mode related to the first position within the image; selecting 
the interaction mode; moving the pointer to a second position within the image by the user 
while performing the selected interaction mode upon the image; and hiding the pointer during 
moving the pointer to the second position within the image. The invention further relates to a 
system (500) for visualizing a pointer during interaction of the pointer with an image, the 
pointer being controllable by a user, the system comprising: a mover (502) for moving the 
pointer to a first position within the image by the user; a displayer (504) for displaying the 
pointer corresponding to an interaction mode related to the first position within the image; a 
selector (506) for selecting the interaction mode; a mover (502) for moving the pointer to a 
second position within the image by the user while performing the selected interaction mode 
upon the image; and a hider (508) for hiding the pointer during moving the pointer to the 
second position within the image. 
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